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Abstract 

Background: Understanding the nature and causes of medical adverse events may help their prevention. This systematic re- 
view explores the types, risk factors, and likely causes of preventable adverse events in the hospital sector. 
Methods: MEDLINE (1970-2008), EMBASE, CINAHL (1970-2005) and the reference lists were used to identify the stud- 
ies and a structured narrative method used to synthesise the data. 

Results: Operative adverse events were more common but less preventable and diagnostic adverse events less common but 
more preventable than other adverse events. Preventable adverse events were often associated with more than one contribu- 
tory factor. The majority of adverse events were linked to individual human error, and a significant proportion of these 
caused serious patient harm. Equipment failure was involved in a small proportion of adverse events and rarely caused pa- 
tient harm. The proportion of system failures varied widely ranging from 3% to 85% depending on the data collection and 
classification methods used. 

Conclusion: Operative adverse events are more common but less preventable than diagnostic adverse events. Adverse 
events are usually associated with more than one contributory factor, the majority are linked to individual human error, and 
a proportion of these with system failure. 
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Introduction 

There are major concerns about the safety of 
healthcare. Previews studies have suggested that 
3 to 17% of hospital admissions lead to adverse 
events and about 30 to 70% of them are prevent- 
able with ordinary standards of care (1-5). These 
studies have shown that in the USA between 
44000 to 98000 people may die each year as the 
result of adverse events, which makes them the 
8 th leading cause of death in the USA (6). In 
addition, adverse events lead to an additional an- 
nual cost of around 37 billion dollars in the USA 
and one to two billion Pounds in the UK (7). Ad- 
verse events also result in many intangible costs 
including pain and discomfort to the patients and 
their families. This has lead to the establishment 
of a number of safety initiatives designed to un- 
derstand the nature and causes of adverse events 



and to prevent their recurrence. Systematic re- 
views of the research evidence are the best way 
of taking stock of the knowledge base (8). Sev- 
eral reviews have investigated the extent, types, 
risk factors and causes of adverse events (9-12). 
A wide ranging review to investigate adverse events 
and the interventions used to prevent them high- 
lighted the need for a systematic review to explore 
the causes of adverse events in order to provide 
insights into how such events might be prevented 
(9). A recent review has summarised the results 
of eight primary studies (1-3, 13-17) on the ex- 
tent and nature of hospital adverse events (12). A 
summary of the studies included in this review 
are presented in Table 1 (12). These studies have 
used similar design for identification and measure- 
ment of adverse events and their contributory fac- 
tors (12). The methods they used were a standard 
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retrospective review of medical records conducted 
in two stages: stage one by trained nurses and 
stage two by medical doctors. They found that 
the median overall incidence of in hospital ad- 
verse events was 9.2%, with a median percentage 
of preventability of 43.5% (Table 1), (12). Previous 
reviews have normally tended to lump all adverse 
events together, ignoring the fact that adverse 
events of different severity might have completely 
different patterns of causes, preventability and out- 
comes (9-12). In other words, they have not 
addressed the types of preventable adverse events 
and the likely causes and factors contributing to 
preventable adverse events. Therefore, the findings 
reported by these reviews are not necessarily a reli- 
able summary of preventable adverse events. This 
paper reports the results of a new systematic 
review of the types, risk factors and likely causes 
of preventable adverse events in secondary care. 

Materials and Methods 

A systematic review of research on the types, 
nature and likely causes of preventable adverse 
events was conducted as follows. Any type of 
empirical study that explicitly investigated the 
types, risk factors and causes of preventable ad- 
verse events in secondary care was considered. 
Exclusion criteria are presented in Table 2. 

Search strategy 

MEDLINE, EMBASE, CINAHL and Psych Info, 
were searched in May 2005 and the MEDLINE 
search was updated in Nov 2008 using a broad 
search strategy. A combination of free text terms 
and MESH terms was used to maximise the sen- 
sitivity of the search strategies. Appropriate search 
strategies were developed for each database with 
the help of expert librarians. 
The databases of theses and dissertations sub- 
mitted to universities and colleges in the UK in- 
cluding SIGLE (System for Information on Grey 
Literature in Europe), the ASLIB Index to theses 
were searched. The World Wide Web address of 
relevant organizations including Institute of Medi- 
cine (IOM), National Patient Safety Foundation 
(NPSF) and Agency for Healthcare Research 



and Quality (AHRQ) in the USA; NPSF and the 
Medicare Advisory Committee in Australia; and 
National Patient Safety Agency (NPSA) in the 
UK were also searched. The reference lists of the 
key reports, dissertations and published papers 
in this field were searched for additional studies. 

Quality assessment 

A combination of quality checklists was used to 
design a list of criteria for appraising the quality of 
included studies (11-13). Depending on the type 
of study design, a combination of criteria was used 
(Table 3). The quality assessment was conducted 
by one reviewer and checked by a second re- 
viewer. Quality was not an inclusion criterion; how- 
ever, the results were interpreted with regard to 
the quality of the included studies, particularly when 
there was significant heterogeneity in the findings. 

Data extraction 

A structured form was used to extract data from 
selected studies. Data were extracted concerning: 
the study aim; design; setting; participants; methods; 
quality and reported results. Data were extracted by 
one reviewer and checked by a second reviewer. 

Method of analysis 

Because of the wide range of types of design and 
significant heterogeneity among the studies, it was 
unsuitable to pool the data, so a structured narra- 
tive method was used to summarise the results (8). 
The summary and interpretation was carried out 
with regard to the study design, setting and quality. 
The analysis provided an explanation of the study 
aim, methods, quality, and results, including the 
study findings on the types, risk factors and likely 
causes of preventable adverse events. Any potential 
heterogeneity was explored by tabulating data. When 
a significant heterogeneity was found possible, 
reasons for that were discussed. In addition, a 
summary result was presented separately for each 
type of specialty and for each type of method. 

Results 

After removal of duplicates, 12856 papers were 
identified from the searches (Fig. 1). The titles 
and abstracts of these papers were scanned and 
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11943 papers were deemed not to meet the in- 
clusion criteria. The full text of 913 papers was 
obtained for further checking against the inclusion 
criteria after which a further 657 studies were ex- 
cluded. The remaining 256 studies investigated the 
types, risk factors and likely causes of adverse 
events in secondary care. Of these studies, 229 did 
not explicitly focus on preventable adverse events 
in secondary care. The remaining 27 papers were 
included, along with a further 9 papers retrieved 
as the second reports of original included studies, 
as these had potential to provide extra informa- 
tion about the original included studies. Therefore, 
36 papers from 27 studies are presented in this 
review. A brief summary of each of the included 
studies appears in Table 4(15, 18-44). 
The majorities of studies were from the USA 
and published after 1990. Twenty-one studies ana- 
lysed preventable adverse events from only one 
specialty. Eleven were conducted in one or a few 
hospitals and seven in teaching hospitals only. 
Twenty-one were retrospective (Table 4). 
Study aims were very diverse. Six studies focused 
on adverse events of any type and the remaining 21 
(78%) studies had specific remits such as anaes- 
thesia and ICU, transfusion, surgery, adverse drug 
events and medication errors, trauma centre, inter- 
nal medicine, cardiology medicine and obstetrics 
(Table 4). 

Although all these papers explored the types, risk 
factors or causes of preventable adverse events, 
this was not necessarily the primary objective. In- 
cluded studies often addressed rather broader 
objectives and only subsequently explored the types, 
risk factors or the likely causes of preventable 
adverse events. This diversity in study aims resulted 
in a wide variation of study methods (Table 4). Data 
on adverse events were generated by case note re- 
view in 10 (37%) studies, reporting systems in 12 
(44%), questionnaire or interview based survey 
in 6 (22%) and review of claims reported to the 
a malpractice insurance company in 2 (7%) studies. 
Three studies used a combination of two methods; 
case note review and interview, case note review 
and reporting system and reporting system and in- 
terview (Table 4). 



Five of the 10 studies using case note review and 
one of the three using a questionnaire analysed ad- 
verse events of any type from a variety of spe- 
cialties. The remaining 21 studies, including all the 
studies which used a reporting system, interview 
or review of claims, analysed only one type of 
adverse event (e.g. adverse drug events) or adverse 
events from one specialty (e.g. ICU), (Table 4). 
All the 10 studies using case note review and 3 
of the 12 using the reporting system had two stages; 
estimating the rate of adverse events or preventable 
adverse events in the first and then the types, risk 
factors or likely causes of preventable adverse events 
in the second stage. Studies, which used interview, 
questionnaire or review of claims, could not of 
course estimate the rate of adverse events (Table 4). 

Quality of included studies 
The quality of the studies or their reporting varied 
widely and was generally poor. Included studies 
often did not provide adequate information about 
their methods particularly how causation and pre- 
ventability were defined, assessed, and used dif- 
ferent and poorly defined subjective classifications 
to analyse adverse events. Use of an established 
incident analysis technique such as root cause 
analysis (RCA) or critical incident technique (CIT) 
for analysing adverse events may increase the level 
of objectivity and reproducibility (11), but only three 
included studies used an established technique to 
analyse adverse events (23, 24, 34), however, they 
did not explain how they implemented the technique. 
Three studies used statistical methods to assess the 
associations between adverse events and risk fac- 
tors, which were not necessarily the causes of ad- 
verse events. These associations could be influ- 
enced by patient case mix and a variety of other 
factors and need further investigation to demon- 
strate a causation link (15, 22, 28). For example, 
adverse events occur more frequent in patients with 
severe conditions, elderly people and patients who 
have a longer length of hospital stay (18, 19) and the 
studies often did not take these factors into account. 
Five of the 10 studies, which used case note re- 
view, were carried out in a reasonably represen- 
tative large sample, randomly selected from a 
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variety of hospitals, and analysed adverse events of 
any type from a wide range of specialties. Despite 
some weaknesses, the overall validity and gener- 
alisability of these studies is likely to be good (15, 
18, 19, 21, 39). The other five studies carried out 
in one hospital, analysed a relatively small num- 
ber of preventable adverse events and/or focused 
only in one specialty or one type of adverse event, 
so their results may not be representative of ad- 
verse events in other hospitals (Table 4). 
Studies, which used data from reporting systems, 
only analysed adverse events from one specialty 
and did not clearly describe how they defined 
and assessed the preventability and causality. The 
adverse events were normally reported by the 
medical and nursing staff involved in or witnessing 
the adverse event. Typically, there was a standard 
form, which required basic clinical details and a 
brief description of adverse event. The information 
from this adverse event form was entered into a 
database and these data were used to classify ad- 
verse events and to attribute the preventability and 
causation link. Little information was given about 
the level of training in people who reported the 
adverse events and those who classified them. 
All the 6 studies which used interview or ques- 
tionnaire analysed adverse events from one spe- 
cialty (Table 4). Two of these did not report the 
number of preventable adverse events (22, 27). The 
other 4 studies analysed between 70 and 146 pre- 
ventable adverse events. Two of these did not re- 
port the response rate (29, 39); one reported a 
response rate of 45% (41) and the other three re- 
ported a response rate of between 78% and 85% 
(22, 25, 27). These studies did not provide a clear 
description of how the preventability and causal- 
ity were assessed. Usually the adverse events were 
analysed according to the judgment of clinicians who 
were interviewed or completed the questionnaires. 

Types of preventable adverse events 
Four studies reported the types of preventable 
adverse events in acute hospitals (Table 5). Three 
of these studies showed that the majority of ad- 
verse events and preventable adverse events were 
associated with a surgical operation. Operative ad- 



verse events accounted for 24%-53% of adverse 
events and 20%-42% of preventable adverse events. 
Errors in evaluation and diagnosis and errors in 
treatment (including drug treatment) were the next 
most common types of preventable adverse events. 
Therapeutic adverse events accounted for 15% to 
28% of preventable adverse events; and diag- 
nostic adverse events accounted for 9% to 21%. 
Drug related adverse events were the next most 
frequent type, accounting for about 10% of pre- 
ventable adverse events. The most frequent type 
of preventable adverse drug event was error in 
dose, followed by error in method of use, inade- 
quate monitoring or follow up, inappropriate drug 
use and administering a drug to the wrong patient. 
Preventable adverse drug events were the most 
common cause of avoidable readmissions to ICU 
and readmissions due to preventable cardiac arrests. 
Although the rate of surgical preventable adverse 
events was highest, surgical adverse events were 
least likely to be preventable. Seventy five percent 
to 100% of diagnostic adverse events and 50% to 
77% of therapeutic adverse events were prevent- 
able, whereas only 17% to 44% of operative adverse 
events were considered preventable. 

Contributing factors 

Preventable adverse events were often associated 
with more than one contributing factor (Table 5-7). 
The majority were associated with individual error 
and a large proportion of these caused serious 
patient harm or death. On the other hand, a small 
proportion of adverse events were associated with 
equipment failure which rarely caused serious harm 
or death. The proportion of system failures con- 
tributing to preventable adverse events varied 
widely, ranging from 3% to 83%. Generally, stud- 
ies, which used reporting data, interview or ques- 
tionnaire, reported a higher rate of system failure 
than studies, which used case, note review (See 
discussion section). 

Type of individual and system errors 
Generally technical errors were the most frequent 
cause of preventable adverse events followed by fail- 
ure to request or arrange investigation or procedure; 
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failure to synthesise, decide or act on information reported by virtually all the studies which pro- 

and lack of care (Table 7). Inexperience and vided relevant data irrespective of the specialty 

communication errors were the two most frequent and the methods used, 
types of system failures (Table 7). This pattern was 



Table 1: Summary of eight studies included in the vries review (12) 



Study 


Country 


Setting 


Data 
year 


Data 
source 


Sample 

size 


Number 
of AEs 


% of 
AEs 


Preventable 

AEs N(%) 


Brennan 1991 (1) 


USA 


51 hospitals 


1984 


CNR (R*) 


30,121 


1133 


3.7 


657 (58) 


ONeil 1993 (14) 


USA 


1 hospital 


1990 


CNR (R) 


3141 


237 


6.8 


103(43.5) 


Wilson 1999 (2) 


Australia 


28 hospitals 


1992 


CNR (R) 


14,000 


2353 


16.6 


1201 (51) 


Thomas 2000 (15; 


USA 


28 hospitals 


1992 


CNR (R) 


15,000 


587 


3.2 


170 (29) 


Vincent 2001(3) 


UK 


2 hospitals 


1998 


CNR (R) 


1014 


110 


10.8 


57(47.9) 


Davis 2003 (16) 


New Zealand 


13 hospitals 


1998 


CNR (R) 


6,579 


850 


12.9 


513 (60) 


Baker 2004 (17) 


Canada 


20 hospitals 


2000 


CNR (R) 


3745 


255 


12 


106(41.6) 


Sari 2006 (13) 


UK 


1 hospital 


2004 


CNR (R) 


1006 


110 


8.6 


33(31) 



*R= retrospective 

Table 2: Exclusion criteria 



Criteria 

Theoretical studies, news, editorials, letters, policy documents and reports 
Single case studies 

Studies from non-health fields, primary care and nursing homes or studies which did not distinguish between secondary care and other settings 
Studies published before 1970 

Studies with language other than English, French, German and Farsi 

Studies documenting the types, risk factors and likely causes of adverse events regardless of their ultimate outcomes 

Studies documenting the types, risk factors and likely causes of adverse events regardless of their preventability 

Table 3: Criteria for appraising the quality of included studies (13) 

Criteria 

A Adequacy of description of study methods 

Clear explanation of terms and classifications used. 

Adequate explanation of how the incidents were defined identified and analysed. 

Adequate explanation of how causation and preventability was defined and assessed. 
B Appropriateness of research methods to the study questions 

Sampling strategy (e.g. type and number of hospitals or specialties). 

Sample size (e.g. number of incidents analysed, interviews or questionnaires). 

Response rate (e.g. for questionnaire or interview based studies). 

Generalisability (e.g. sampling, setting, case mix). 
C Quality of data collection 

Source of data (e.g. case note review, reporting system, interview, questionnaire). 

Method of data collection (e.g. structured or unstructured review). 

Validity and reliability of measurement tools (e.g. questionnaires, review forms). 

Who collected the data (profession, experience, training). 

How the criteria of preventability and causation applied (e.g. threshold of causality). 

How many people applied the criteria/how the consensus was made. 

Was the inter-rater reliability checked, level of inter-rater reliability. 
D Quality of data analysis 

Time lag between incident and analysis (e.g. recall bias if interviews or questionnaire). 

Incident analysis approach (e.g. use of a standard incident analysis technique). 

Adequate explanation of incidents with regard to: what happened, how and why. 

Covering both individual and system-based factors. 
E Quality of data presentation 

Presentation of results and discussion section (e.g. do the data support the results?). 

Adequate explanation of confounding factors (e.g. patient condition, age, case mix). 
Adequate explanation of the possible study weaknesses and limitations. 
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Table 4: Summary of studies included in the review 



tudy 


Country 


Setting/specialty 


Focus 


Data year 


Data source (Prospective or 
retrospective) 


Sample size 


Number of AEs/ 
incidents 


Number of preventable 

AEs (%) 


„„„„ inm /io\ 

,eape lyyi (la) 


USA 


51 hospitals 


Ah 


i no a 
1984 


CJNK (K) 


30,121 
admissions 


1133 


03 / {DiS) 


Wilson 1999 (19) 


Australia 


28 hospitals 


AE 


1992 


CNR (R) 


14,000 admissions 


2353 


1201 (51) 


Jeale 2001(20) 


UK 


2 THs 


AE 


1 Ann o aaa 

1999-2000 


CNR (R) 


1,000 admissions 


119 


57 (48) 


>avis zuuj 


New 
Zealand 


13 hospitals 


Ad 


1 QQS 
lyyo 




6,579 
admissions 


oDU 


jIj \0V) 


'homas2000(15) 


USA 


28 hospitals 


AE 


1992 


CNR (R) 


15,000 
admissions 


587 


170 (29) 


laldwin 1998 (22) 


UK 


Acute hospitals 


Mistake 


1993-1996 


Questionnaire (R) 


142 doctors 






lawande 2003a (23) 


USA 


Surgery (3 TH) 


Errors 


2000-2001 


Interview & reporting (R) 


38 doctors 




146 


CAHO 2001 (24) 


USA 


Surgery units 


Wrong site surgery 


Before 2001 


National reporting (R) 


- 


- 


126 


lawande 2003b(25) 


USA 


Surgery (insurer) 


Retained foreign body 


1985-2001 


Claims notes (R) 


- 


- 


61 


lates 1993 (26) 


USA 


1 hospital (tertiary) 


ADE 


- 


CNR & reporting (P) 


2,967 patient days 


73 


15(21) 


'ohen 1998 (27) 


USA 


200 hospitals 


Medication error 


1994-1995 


Questionnaire (R) 


156 clinicians 


951 




'^r>A onm iOQ\ 
pond ZUU1 (zo J 


U^A 


1116 hospitals 


Medication error 


iyyz 


National reporting (R) 


1116 hospitals 


4jU,joo 


1 "7 1 (A \ 
1 /,jjo (4) 


toper 1984 (29) 


USA 


4 units of anaesthesia 


Incident 


Before 1984 


Interview (R) 


139 interviews 


1089 


70 (6) 


d-bous 2001 (30) 


Nether-ands 


anaesthesia units 


Preventable death 


1995-1997 


Reporting (P) 


869,483 patients 


811 


119(15) 


[art 1994 (3D 


AiKtrali a 

i \ LI J 1 1 till CI 


1 ICU unit 


TtiHHpTit 


1991-1993 


Rpnortinc* (T*\ 


21 53 natients 


390 


(106 harms) 


luckley 1997 (32) 


Hong Kong 


1 ICU (TH) 


Incident 




Reporting (P) 


3300 patients 


281 


- 

(39 harms) 


)archy 1999 (33) 


France 


1 ICU (TH) 


Iatrogenic disease 


1994 


CNR (R) 


623 patients 


68 


35 (51) 


Iracco 2001 (34) 


Switzer-land 


1 ICU unit 


Incident 


1995-1996 


Reporting & observation (P) 


1024 patients 


111 


- (241 errors) 


toen 2002 (35) 


UK 


Transfusion (199 units) 


Error 


1996-2001 


Reporting (R) 




699 


77(11) 


lurphy 1989 (36) 


UK 


Transfusion (1 TH) 


Cross-match error 


1986-1987 


Reporting (R) 






5 


lonig 1980 (37) 


USA 


Transfusion 
(national) 


Preventable death 


1976-1978 


Mandatory reporting (R) 




70 


37 (53) 


azama 1990 (38) 


USA 


Transfusion 
(national) 


Preventable death 


1976-1985 


Mandatory reporting (R) 




355 


256 (72) 


)avis 1992(39) 


USA 


6 trauma centres 


Error 


1985-1989 


CNR, interview (P) 


22,577 patients 




1,032 


:ayten 1991 (40) 


USA 


8 trauma centres 


Preventable death 


1987-1989 


CNR and autopsy notes (R & P) 


13,500 patients 


421 


50(12) 


Vu 1991 (41) 


USA 


Internal med (1 TH) 


Mistake 


1989 


Questionnaire (R) 


254doctors 


114 


87 (76) 


ledell 1991 (42) 


USA 


1 card, unit (TH) 


Iatrogenic card, arrest 


1981 


CNR (R) 


203 Patients 


28 


18 (64) 


:nnis 1990 (43) 


UK 


Obstetrics (insurer) 


Serious accident 


1982-1989 


Claims notes (R) 




64 





ADE=adverse drug event , AE= adverse event, CNR= case note review, P=prospective, R=retrospective, TH=teaching hospital 
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Table 5: Number and percentage of AEs and preventable AEs by types in acute hospitals 



Study 



Leape et al 1991 (18) 



Wilson et al 1995 (2) 



Vincent et al 2001a (3) 



Davis et al 2003 (21) 



Specialties 

Threshold for causation 
Threshold for preventability 



All SPs except MH 

Likelihood of >50% 
Likelihood of >50% 



All SPs except MH 

Any evidence 
Likelihood of >50% 



GS, OR, GM, OB 

Likelihood of >50% 
Likelihood of >50% 



All SPs except MH 

Any evidence 
Likelihood of >50% 



Type of AE 


AE 

N(%) 


PAE 

N(%) 


% of PAEs 


AE 

N(%) 


PAE 

N(%) 


% of 
PAEs 


AE 

N(%) 


PAE 

N(%) 


% of 
PAEs 


AE 

N(%) 


PAE 

N(%) 


Diagnostic 


79 (7) 


59(19) 


75 


314(13) 


254 (21) 


81 


5(4) 


5(9) 


100 


85 (8) 


50 (14) 


Operative 


599(53) 


101(32) 


17 


1159 (49) 


509 (42) 


44 


49 (42) 


11 (20) 


22.4 


258 (24) 


99 (29) 


Procedural 


88 (8) 


13(4) 


15 


197 (8) 


78(6) 


40 


5(4) 


4(8) 


80 


82 (8) 


34 (10) 


Therapeutic 


62 (6) 


47(15) 


77 


276 (12) 


200(16) 


72 


30 (25) 


15 (28) 


50 


89 (8) 


49 (15) 


Drug related 


178(16) 


31 (10) 


18 


249 (11) 


107 (9) 


43 


17 (14) 


9(17) 


53 


130(12) 


33 (10) 


System failure 


29 (3) 


10(3) 


36 


355 (15) 


277 (23) 


78 








254 (24) 


157 (47) 


Other 


98 (9) 


51 (16) 


52 








12(10) 


10(19) 


83 


162(15) 


54 (14) 


Total 


1133 (100) 


312 (100) 


28 


2353 (108) 


1200 (117) 


51 


119 (100) 


57 (100) 


48 


850 (100) 


339 (40) 



PAE = preventable adverse event; SPs=specialties. The categories are not all mutually exclusive and so some total % are more than 100 



Table 6: Factors contributing to adverse events 



Studies used record 
review 


Method 


Type of AEs analysed 


N of AEs preventable 


% due to individual 
failures 


% due to 
system failures 


% due to equipment 
failures 


Leap 1991 (18) 
Wilson 1999 (19) 


CNR 
CNR 


All types 
All types 


657 
1922 


97% 
82% 


3% 
23%* 




Davis 2003 (21) 


CNR 


All types 


339 


93% 


47%* 




Studies used reporting 
system 


Method 


Type of AEs analysed 


N of AEs preventable 


% due to individual 
failures 


% due to 
system failures 


% due to equipment 
failures 


Gawande 2003a (23) 

Arbous 2001 (30) 
Sazama 1990 (38) 
JCAHO 2001 (24) 


Interview, 
reporting 
Reporting 
Reporting 
Reporting 


Surgical errors 

Anaesthesia related deaths 
Transfusion deaths 
Wrong site surgery 


146 

119 
256 
126 


86% 

75% 
100% 


83%* 

60%* 
In many instances 
The majority 


5% 
0 



The sum of individual and system based errors may be >100% because some adverse events are associated with both types of errors. 
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Table 7: Distribution of individual and system errors 



Studies used case note review 



Leape 1991 (18) 



Wilson 1999 (19) 



Method 

Type of adverse event 

Type of errors contributing to AE* 

Total individual errors 

Technical 

Synthesise, decide or act on information 

Failure to request or arrange investigation/ procedure 

Lack of care or attention or failure to attend 

Failure to apply a rule or use of a bad/inadequate rule 

Practicing outside area of expertise 

Violation of policy or protocol 

Slips or lapses 

Lack of knowledge 

Failure of judgement 

Failure of memory 

Failure of vigilance 

Total system failure 

Inadequate training, experience or supervision 
Inadequate reporting or communication 
Inadequate or delayed scheduling 
Inadequate monitoring systems 
Fatigue or workload 
Inadequate resource, equipment or staff 
Inadequate function of services 
Defective equipment 

Absence of or failure to use policy, protocol or plan 
Inadequate care 
Organisational factors 
Other 

Total number of errors 
Studies used reporting system 

Method 

Type of adverse event 

Type of errors contributing to AE* 

Total individual errors 

Technical 

Synthesise, decide or act on information 

Failure to request or arrange investigation/ procedure 

Lack of care or attention or failure to attend 

Failure to apply a rule or use of a bad/inadequate rule 

Practicing outside area of expertise 

Violation of policy or protocol 

Slips or lapses 

Lack of knowledge 

Failure of judgement 

Failure of memory 

Failure of vigilance 

Total system failure 

Inadequate training, experience or supervision 
Inadequate reporting or communication 
Inadequate or delayed scheduling 
Inadequate monitoring systems 
Fatigue or workload 
Inadequate resource, equipment or staff 
Inadequate function of services 
Defective equipment 

Absence of or failure to use policy, protocol or plan 
Inadequate care 
Organisational factors 
Other 

Total number of errors 



Case note review 
Any type 
No (%) 
1223 (94) 
559 (43) 
163(13) 
223 (17) 



115(9) 



82 (6) 
15(1.1) 
11 (0.8) 
10 (0.8) 
8 (0.7) 

13(1.0) 

7 (0.6) 

8 (0.7) 



10 (0.8) 
1305 (100) 
Gawande 2003a (23) 
Interview reporting 
Surgical 
No (%) 
169 (40) 



92 (22) 

5(1) 
72(17) 
252 (60) 
104 (25) 
62(15) 



21(5) 
30 (7) 

22 (5) 
2 (0.4) 



421 (100) 



Case note review 
Any type 
No (%) 
2655 (89) 
1017(34) 
465 (16) 
346 (12) 
320(11) 
258 (9) 
30(1) 
140 (5) 
46 (2) 
33(1) 



332(11) 
44(1.5) 
62 (2.0) 



8 (0.3) 
16 (0.5) 
5 (0.2) 
188 (6.3) 



9 (0.3) 
2987 (100) 
Arbus 2001 (30) 

Reporting 
Anaesthesia 
No (%) 
334 (77) 



329 (50) 
126(19) 

33 (5) 



0(0) 

80 (12) 
90 (14) 
11(3) 
663 (100) 



*AEs may have more than one error, so the number of errors may be more than in Table 3. 
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Total number of citations after 
duplicate check (12856) 



Excluded by checking 
titles and abstracts 
(11943) 



Full report obtained for 
further assessment 
(913) 



Investigated the types, 
risk factors and likely 
causes of incidents (256) 



Excluded by checking 
full report (657) 



Included (27) 

Plus second report of 
included studies (9) 



Excluded because did not explicitly 
focus on preventable adverse 
events in secondary care (229) 



Fig. 1: Number of studies excluded in each stage 



Discussion 

This review found that operative adverse events 
were more common but less preventable than 
other types of adverse events. On the other hand, 
diagnostic adverse events were less common but 
more preventable than other types of adverse 
events. Preventable adverse events are often as- 
sociated with more than one contributory factor, 
with the majority associated with individual error 
and a significant proportion with system failure. 



While technical errors and cognitive failures were 
the most common types of error, lack of ex- 
perience, inadequate supervision of junior staff and 
problems in communications were the most com- 
mon types of system error. 

Operative adverse events were the most com- 
mon type of preventable adverse events proba- 
bly because the majority of admissions in the 
sampling frame were in surgical wards and sub- 
sequently the majority of study samples were se- 
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lected from these wards (1-3, 21). Although 
technical error may be the most common cause 
of preventable operative adverse events, this may 
not be the most common type of other (such as 
diagnostic or therapeutic) preventable adverse 
events. There were no explicit data on the type of 
individual error for each group of adverse events. 
The wide variation in the proportion of system 
failure reported reflects two factors. Firstly, the 
majority of preventable adverse events, which were 
associated with a system failure, were also as- 
sociated with other factors including individual hu- 
man error. Even in studies in which a large pro- 
portion of adverse events were associated with a 
system failure, only a small number reported sys- 
tem failure as the main or the sole cause of ad- 
verse event (16, 30). Studies which reported a 
small proportion of adverse events due to a sys- 
tem failure, only noted system failure when it was 
the main or the sole rather than a contributory 
cause of adverse events (16, 18, 20, 23, 30). 
Secondly, the reported proportion of system fail- 
ures was strongly related to the methods used. Stud- 
ies which used case note review to identify and 
analyze adverse events reported a significantly lower 
proportion of system failures than studies which 
used interview, questionnaire or reporting system 
data (18-20, 23, 24, 30). This is probably because 
the retrospective case note review often focuses 
more on the actions of clinicians in the frontline, 
and less on the actions of other staff or systems 
with a more supportive role (19). Therefore, some 
potentially important contextual events might not 
be recorded in the case notes (19). Hence, retro- 
spective case note review may not provide suf- 
ficient information to uncover the underlying causes 
of adverse events, such as system failures (19). 
On the other hand, data collected by the report- 
ing system, interview, or questionnaire may be bi- 
ased toward the role of system failure and focus 
less on the role of the individual error (45, 46). 
Clinicians may report adverse events in a way that 
shifts the responsibility from the individual and 
toward system factors. Case note review, there- 
fore, may overestimate the role of individual hu- 



man factors and underestimate the role of system 
factors, while reporting systems and interviews or 
questionnaire-based studies probably do the reverse 
(13,47). 

Limitations of the included studies 
The majority of included studies were conducted 
in a single specialty in one or a few hospitals. 
The patient case mix, the type of practice and 
subsequently the causative pattern of adverse events 
in these specialties might differ from other spe- 
cialties, so the results of these studies are not 
necessarily general sable to the routine practice in 
secondary care. The majorities of included studies 
were also small and analyzed a small number of 
preventable adverse events, probably with too little 
statistical power to detect significant associations 
between the categories of preventable adverse events 
and other factors. 

Ten of the 12 included studies, which used case 
note review or review of litigation notes, were 
retrospective. This method is dependent on the 
adequacy of case notes and perception of people 
who reviewed them (1,2). 

Retrospective case note review may provide in- 
adequate information for uncovering the un- 
derlying causes of adverse events (19). The stan- 
dard of care that forms the basis for any judg- 
ment of error is rarely well defined and is open 
to interpretation (2). The majority of the in- 
cluded studies did not check the inter-rater reli- 
ability of clinician's judgement on the preventability 
of adverse events, but those which did, reported 
only a moderate or poor reliability (2, 20). 
Twelve of the 27 included studies used reporting 
system data for identifying and analysing adverse 
events. Studies which used reporting data ana- 
lysed a range of 5 (36) to 430,000 adverse events 
(28). The results of these studies might be biased 
by the significant under-reporting, selective report- 
ing (e.g. of more minor incidents) (47) and in- 
complete or incorrect reporting (23, 28, 47, 48). 
The level of under-reporting may be larger when 
the reporting system operates voluntarily, as it was 
in all but two (37, 38) of the included studies 
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which used reporting data. Overall, reporting sys- 
tem data seem to be less reliable than data re- 
corded from case notes. 

Six of the 27 included studies used questionnaire 
or interview, and five of these were retrospective 
increasing the possibility of recall bias (23, 49, 
50). Webb and Davies (51) found that unusual, 
interesting, and particularly dangerous adverse 
events are more likely to be reported than minor 
ones. Minor errors, errors of omission and errors 
that occurred well before the date of the report 
are less easily remembered (23). In addition, the 
information on factors that clinicians think con- 
tributed to the adverse events may differ because 
of inaccurate clinician recall (23). Adverse events 
detected by reporting systems, interview or ques- 
tionnaire might be influenced by the perception 
or characteristics (e.g. personality) of the people 
who make the report (23). 

Two studies used review of claims reported to a 
malpractice insurance company (25, 43), but since 
few adverse events result in a claim these stud- 
ies considered a small number of probably unrep- 
resentative adverse events. Ennis et al found that 
normally only very serious adverse events were re- 
ported to the malpractice insurance companies (43). 
The majority of adverse events identified by re- 
porting systems are reported by nurses (50), 
while most of the adverse events identified by 
questionnaires or interviews are reported by doc- 
tors, as all these studies were carried out among 
doctors who in many cases were specialists (22, 
23, 27, 29, 32, 41). The type of adverse event 
reported by a doctor might differ from those 
reported by a nurse. For example, doctors tend 
to report more serious adverse events (26, 50, 51) 
and adverse events which are highly preventable 
(14, 52). Hence, the severity and causative nature 
of adverse events, which are reported by the in- 
terview or questionnaire, may differ from those, 
which are recorded by reporting systems; and all 
of these may differ from those identified by re- 
cord review. Therefore, it is possible that different 
methods or even similar methods of different 
quality will produce different patterns. To minimise 
bias, we considered the results with regard to 



method and possible reasons for variations in the 
findings were discussed. 

Limitations of the review 

Search techniques for identifying non-experimental 
studies are still developing (8). A broad search 
approach was used to maximise the number of 
potentially relevant studies identified, though re- 
levant studies may have been missed. It is also 
possible that studies with specific designs or find- 
ings, for example, studies with interesting, un- 
usual or particular results have been more likely 
(or possibly less likely) to be published in aca- 
demic journals. The broad search, which included 
hand searching of grey literature and contacting 
relevant individuals and organizations, should have 
reduced the risk of publication bias. 
There was a great deal of heterogeneity in the 
studies included in this systematic review, so that 
quantitative meta-analysis was unsuitable. To ex- 
plore potential heterogeneity resulting from study 
designs, summary results were presented sepa- 
rately for each specialty and for each method (53). 
The consistency, or lack thereof, in the results of 
different types of studies was discussed, as were 
possible reasons for heterogeneity (54). Studies 
were not excluded based on their quality, but the 
quality of included studies was assessed and re- 
ferred to, in particular when there was significant 
heterogeneity in the findings. 

Gaps in research 

This review has shown that a wide range of 
methods has been used to identify and analyse 
adverse events, each with some important limita- 
tions. The majority of included studies gave an 
inadequate description of the methods. They used 
different criteria and measurement tools to iden- 
tify and analyse adverse events and even the same 
criteria were applied in different ways. This made 
comparison between the studies very difficult. 
We recommend that future research focus on the 
development and testing of an optimal cost-ef- 
fective set of standard methods to identify and 
analyse different types of adverse events and moni- 
tor the impact of safety improvement programmes. 
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Until a more accurate and standard method or 
combination of methods is developed, it is very 
important that studies provide sufficient detail 
about the concepts underlying the terms used 
and about the way the data have been collected 
and analysed. In particular, a clear description 
should be given as to the definition and assessment 
of the preventability and causation link. This 
information will improve the accuracy of the com- 
parisons across the studies. 
This review showed that the majority of studies 
in this area have lumped together and analysed 
adverse events of various types of any severity, 
regardless of their preventability and ultimate 
outcomes; ignoring the fact that adverse events of 
various types and severity might have a different 
pattern of causes, so future studies should analyse 
adverse events with regard to their preventability, 
severity and ultimate outcomes. 
In conclusion, although several reviews have ex- 
amined the types, risk factors and likely causes of 
adverse events, their potential preventability, and 
ultimate outcomes have, for the most part, been 
ignored. This is the first comprehensive review 
to systematically document and analyse prevent- 
able adverse events in secondary care. It pro- 
vides evidence that operative adverse events are 
more common but less preventable and diagnos- 
tic adverse events less common but more prevent- 
able than other adverse events. Preventable ad- 
verse events were often associated with more than 
one contributory factor. The majority were linked 
to individual human error, and a proportion of 
these with system failure. This review makes a 
significant contribution to our understanding of me- 
thods of detecting and analysing adverse events 
particularly in the hospital sector. Improvement 
programmes should focus more on preventing op- 
erative and diagnostic adverse events and on com- 
mon individual and system errors such as techni- 
cal errors, supervision of junior staff and com- 
munication between all parties in secondary care. 
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